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1  Motivation 

This  grant  has  focussed  on  the  development  of  new  techniques  for  very  rapid 
and  repeated  evaluation  of  outputs  of  elliptic  partial  differential  equations.  The 
goal  is  to  develop  methods  that  are  sufficiently  fast  to  permit  general  design 
and  optimization  studies,  that  is,  full  exploration  of  the  design  space  of  interest. 
Initially  we  approached  the  problem  through  “computer-simulation  surrogates” : 
input-output  pair  interpolations  validated  via  statistical  measures.  However, 
these  surrogates  degraded  very  rapidly  with  increasing  design-space  dimension, 
both  as  regards  their  approximation  properties  and  also  in  terms  of  the  relevance 
of  the  probabilistic  validation  statement.  We  thus  turned  to  a  second  approach 
which,  because  it  is  based  on  an  underlying  state-space  representation,  fares 
much  better  with  increasing  dimensionality;  furthermore,  the  associated  error 
estimates  are  no  longer  statistical,  and  thus  much  more  useful  in  practice.  In  this 
report  we  motivate  and  explain  these  techniques  in  a  particular  (simple)  context, 
and  also  indicate  the  various  extensions  that  have  been  developed  in  order  to 
treat  a  larger  class  of  problems.  This  report  (minus  this  paragraph)  has  also 
appeared  recently  in  the  SIAM  SIAG/OPT  newsletter  Volume  11,  Number  2. 

To  motivate  and  illustrate  our  methods  we  consider  a  specific  example:  a 
thermal  fin.  The  fin,  shown  in  Figure  1,  consists  of  a  central  “post”  and  four 
“subfins;”  the  fin  conducts  heat  from  a  prescribed  uniform  flux  “source”  at  the 
root,  rr0ot,  through  the  large-surface- area  subfins  to  surrounding  flowing  air. 
The  fin  is  characterized  by  seven  design  parameters,  or  “inputs,”  ^  E  V  C  IRP=7, 
where  fi%  —  k1,  i  =  1, . . . ,  4,  =  Bi,  fj?  =  L,  and  (i7  =  t.  Here  kl  is  the  thermal 

conductivity  of  the  ith  subfin  (normalized  relative  to  the  post  conductivity);  Bi  is 
the  Biot  number,  a  nondimensional  heat  transfer  coefficient  reflecting  convective 
transport  to  the  air  at  the  fin  surfaces;  and  L  and  t  are  the  length  and  thickness 
of  the  subfins  (normalized  relative  to  the  post  width).  The  performance  metric, 
or  “output,”  s  €  1R,  is  chosen  to  be  the  average  temperature  of  the  fin  root 
normalized  by  the  prescribed  heat  flux  into  the  fin  root.  In  order  to  optimize 
the  fin  design,  we  must  be  able  to  evaluate  s(/x)  repeatedly  and  rapidly. 

1The  material  presented  here  is  work  performed  in  collaboration  with  Professor  Yvon  Ma- 
day  of  University  of  Paris  VI  and  reported  in  greater  detail  in  references  [1,  2,  3,  4]. 
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Figure  1 


We  can  express  our  input-output  relationship  as  s  =  -£°(w(/x)),  where  £°(v)  is 
a  (continuous)  linear  functional  —  £°(v)  =  fr  —  and  is  the  tempera¬ 
ture  distribution  within  the  fin.  (The  temperature  field  is  of  course  a  function  of 
the  spatial  coordinate,  x\  we  explicitly  indicate  this  dependence  only  as  needed.) 
The  temperature  distribution  u(/i)  G  Y  satisfies  the  elliptic  partial  differential 
equation  describing  heat  conduction  in  the  fin, 

a(u,v;  fjb)  =  £(v),Vv  €  Y\  (1) 

a{u,v\ji)  is  the  weak  form  of  the  Laplacian,  and  £{v)  reflects  the  prescribed 
heat  flux  at  the  root.  Here  Y  is  the  appropriate  Hilbert  space  with  associated 
inner  product  (•,  -)y  and  induced  norm  ||  •  ||y  2.  The  bilinear  form  a(-,-;^) 
is  symmetric,  a(w,v\/i)  =  a(vy  w\  //),  Vic,  v  G  F2,V/i  G  V\  uniformly  continu¬ 
ous,  \a(w,v;fi)\  <  7||^||y |M|y, Vu>,t>  G  T2,V/t  G  and  coercive,  a||t;||y  < 
o(v,  v\  /i),  Vv  G  y,V/i  G  V.  Here  a  and  7  are  strictly  positive  real  constants. 
Finally,  the  form  £{v)  is  a  linear  bounded  functional;  for  our  choice  of  scaling 
and  output,  t°(v)  =  £(v),  which  we  will  exploit  to  simplify  the  exposition. 

It  can  further  be  shown  for  our  problem  that  a  can  be  expressed  as 

Q 

a(w,v\{i)  =  '^aq(fjL)aq(w,v),Vwyv  G  y2,V/t  G  P,  (2) 

q=l 

for  appropriately  chosen  functions  <jq:V  —>  R  and  associated  ^-independent 
bilinear  forms  aq:Y  xY  — ►  R,  g  =  1, . . . ,  Q.  Note  that  we  pose  our  problem  on 
a  fixed  fin  reference  domain  £1  in  order  to  ensure  that  the  parametric  dependence 
on  geometry  —  L  and  t  —  enters  through  a(*,  -;/j)  and  ultimately  the  crq(fj). 
For  our  particular  problem,  Q  =  15;  if  we  freeze  (fix)  all  parameters  except  L 
and  t  (such  that  Peff  =  2),  Q  =  8;  if  we  freeze  only  L  and  t  (such  that  Pe $  =  5), 
Q  =  6. 

In  the  context  of  design,  optimization,  and  control,  we  require  very  rapid 
response  and  many  output  evaluations.  Our  goal  is  thus  to  construct  an  approx¬ 
imation  to  uQu),  tt(/i),  and  hence  approximation  to  s(/t),  s(fi)  =  £°(u(fj, -)),  which 

2Here  Y  =  if1  (£2),  the  space  of  functions  that  are  square  integrable  and  that  have  square 
integrable  first  (distributional)  derivatives  over  the  fin  reference  domain  Q.  The  inner  product 
(w,  v)y  may  be  chosen  to  be  Vw  *  Vv  +  wv. 
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is  (i)  certifiably  accurate,  and  (ii)  very  efficient  in  the  limit  of  many  evaluations. 
By  the  former  we  mean  that  the  error  in  our  approximate  output,  |s(/z)  —  s(/z)|, 
is  guaranteed  to  be  less  than  a  prescribed  tolerance  e;  by  the  latter  we  mean 
that,  following  an  initial  fixed  investment,  the  additional  incremental  cost  to 
evaluate  s(/z)  for  any  new  \i  G  V  is  much  less  than  the  effort  required  to  directly 
compute  s(fjb)  —  £°(u(fj ,))  by  (say)  standard  finite  element  approximation. 


2  Reduced-Basis  Approximation 

Reduced-basis  methods  (e.g.,  [5,  6,  7])  are  a  “parameter-space”  version  of  weighted- 
residual  (here  Galerkin)  approximation.  To  define  our  reduced-basis  procedure, 
we  first  introduce  a  sample  set  in  parameter  space,  SN  =  {//i ,  and 

associated  reduced-basis  space  WN  =  span{£n  =  u(/zn),n  =  1, . , .  ,  AT},  where 
u{fin)  satisfies  (1)  for  /x  =  //n  G  V  (note  fi1  refers  to  the  ith  component  of  the 
P-tuple  /x,  whereas  //n  refers  to  the  nth  P- tuple  in  SN).  We  then  require  our 
reduced-basis  approximation  to  u{jj)  for  any  given  /x,  uN(fi)  G  WN  C  Y,  to 
satisfy 

a(uN(fi),  v;  fi)  —£(v)yv  G  WN ;  (3) 

the  reduced-basis  approximation  to  s(/x)  can  subsequently  be  evaluated  as  sN(fi)  = 

It  is  a  simple  matter  to  show  that 

\\u(n)  -uw(/x)||y  <  min  \\u(fi)  -  wN\\Y, 

V  £  VV /V 

which  states  that  our  approximation  is  optimal  in  the  Y  norm 
readily  shown  for  our  particular  problem  that 

s(n)  =  sN(fi)  +  a{eN(/j),eN(n);  fi),  (5) 

where  eN  =  u  —  uN .  It  follows  from  (4), (5),  and  the  continuity  of  a  that 

Km)  -  sN(m)I  <  t~(  min  ||w(m)  -  K^lly)2;  (6) 

a  wNewN 

thus  our  output  approximation  is  also  optimal. 

We  must,  of  course,  also  understand  the  extent  to  which  the  best  wN  in  WN 
can,  indeed,  approximate  the  requisite  temperature  distribution.  The  essential 
point  is  that,  although  WN  clearly  does  not  have  any  approximation  properties 
for  general  functions  in  Y,  simple  interpolation  arguments  in  parameter  space 
suggest  that  WN  should  approximate  well  u(ffi)  even  for  very  modest  N ;  indeed, 
exponential  convergence  is  obtained  in  N  for  sufficiently  smooth  //-dependence 
(e.g.,  [6,  7]).  It  is  for  this  reason  that,  even  in  high- dimensional  (large  P) 
parameter  spaces,  reduced-basis  methods  continue  to  perform  well  —  indeed, 
thanks  to  (6),  much  better  than  ad  hoc ,  uncontrolled  “non-state-space”  fits  of 
(//,  s(fi))  input-output  pairs. 


(4) 

.  It  can  also  be 
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We  now  turn  to  the  computational  issues.  We  first  express  the  reduced-basis 
approximation  as 


uN(x;  n)  =  =  (aAr(*l))TC(*)>  (7) 

3  =  1 

and  choose  for  test  functions  v  =  (i(x ),i  =  1,...,AT.  We  then  insert  these 
representations  into  (3)  to  yield  the  desired  algebraic  equations  for  uN (fi)  E  IR^, 

N 

Yla(Cj,(i‘,n)u?  =  ^(C»).  i  =  (8) 

j=l 

Equation  (8)  can  be  written  in  matrix  form  as 

A(n)uN(fj,)  -  L,  (9) 

where  A{ji)  E  JRNxN  is  the  SPD  matrix  with  entries  Aij(ff)  =  a(Cj-,0;/x),  1  < 
i,j  <  AT,  and  L  E  IR^  is  the  “load”  vector  with  entries  Li  =  1  <  i  <  iV. 

We  now  invoke  (2)  to  note  that 

Q 

=  a(Cj)  Cii  f1)  =  ^(aO^CCj  ?  Ci) 

9=1 

Q 

=  (10) 

9=1 

where  the  matrices  A9  E  Hiv><j/v  are  given  by  A?j  =  aq(QXi)i  1  <hj<Nyq  = 
1, . . . ,  Q.  The  off-line/on-line  decomposition  is  now  clear.  In  the  off-line  stage, 
we  construct  the  Aq,  q  =  1, . . . ,  Q.  In  the  on-line  stage,  for  any  given  j. i ,  we  first 
form  A  from  the  Aq  according  to  (10);  we  next  invert  (9)  to  find  uN (fi)]  and  we 
then  compute  sN (ff)  =  (°(uN  (p))  =  £(uN(p))  =  {uN(p))TL.  As  we  shall  see, 
N  will  typically  be  0(10)  for  our  particular  problem.  Thus,  as  required,  the 
incremental  cost  to  evaluate  sN (p)  for  any  given  new  p  is  very  small:  0(N2Q) 
to  form  A(p);  0(N3)  to  invert  (the  typically  dense)  A{p)  system;  and  O(N)  to 
evaluate  sN(p)  from  uN  (p). 

The  above  a  priori  results  tell  us  only  that  we  are  doing  as  well  as  possible; 
it  does  not  tell  us  how  well  we  are  doing.  Since  the  error  in  our  output  is  not 
known,  the  minimal  number  of  basis  functions  required  to  satisfy  the  desired 
error  tolerance  can  not  be  ascertained.  As  a  result,  either  too  many  or  too 
few  functions  are  retained;  the  former  results  in  computational  inefficiency,  the 
latter  in  unacceptable  uncertainty.  We  thus  need  a  posteriori  error  bounds  as 
well. 
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3  Output  Bounds 

To  begin,  we  assume  that  we  may  find  a  function  g(fi):V  — *  1R+  and  a  symmetric 
continuous  coercive  bilinear  form  d:  Y  x  Y  — » IR  such  that 

c\\v\\y  <  g(g)a{v,v)  <  a(v,v;g)yv  £F,V/j£  V,  (11) 

for  some  real  positive  constant  c;  for  our  thermal  fin  problem  we  can  readily 
find  a  g(g)  and  a(u>,  v)  such  that  (11)  is  satisfied.  The  procedure  is  then  simple: 
we  first  compute  e{g)  €  Y  solution  of 

g(n)a(e(fi),  v )  =  R(v;  g),  Vv  <=  Y,  (12) 

where  R(v;  g)  =  £(v)  —  a(uN ,  v;  g)  is  the  residual;  we  then  evaluate  our  bounds 
as 

«-(m)  =  sN(g),  s^.(g)  =  sN(g)  +  AN(g),  (13) 

where  AN(g),  the  bound  gap,  is  given  by 

&N(l*)  =  9(g)a(e{g),  e(g)).  (14) 

The  notion  of  output  bounds  is  not  restricted  to  reduced-basis  approximations: 
it  can  also  be  applied  within  the  context  of  finite  element  discretization  as  well 
as  iterative  solution  strategies  [8,  9]. 

We  can  then  show  that 

s.(g)  <  s(g)  <  s%(g),  VAT;  (15) 

we  thus  have  a  certificate  of  fidelity  for  sN  —  it  is  within  A N(fi)  of 
To  prove  the  left  inequality  we  appeal  to  (5)  and  the  coercivity  of  a.  To 
demonstrate  the  right  inequality  we  first  note  that  R(eN((j,);  fi)  —  t(eN (fi))  — 
a(uN(fi),  eN(fi)]  g)  =  a(eN(fi),  eN(n);  //),  since  t(eN((j,))  =  a(u,  eN(fi)\ fi)  from 
(1)  for  v  =  eN (ji)\  we  next  choose  v  —  eN (ji)  in  (12)  to  obtain  g(jj,)a(e(fi),eN (g,))  = 
a(eN(fi),  eN {(i );  fi)\  then  from  the  right  inequality  of  (11)  we  have 

Aw(m)  =  g(ii)a{e,e) 

=  g(fi)a(e  —  eN ,  e  —  eN )  +  2  a(eiV,  eN) 

-  g(g)a{eN  ,eN) 

>  g(g)a(e  —  eN,e  —  eN)  +  a(eN,eN); 

from  the  left  inequality  of  (11)  we  thus  conclude  that  A N(fi)  >  a(eN,eN);  a 
comparison  of  (5)  and  (13)  then  completes  the  proof. 

We  can  now  ascertain,  through  AN )  the  accuracy  of  our  output  prediction, 
which  will  in  turn  permit  us  to  adaptively  modify  our  approximation  until  the 
prescribed  error  tolerance  £  is  satisfied.  However,  it  is  also  critical  that  AN(fi) 
be  a  good  error  estimator;  a  poor  estimator  will  encourage  us  to  unnecessar¬ 
ily  refine  an  approximation  which  is,  in  fact,  adequate.  To  prevent  the  latter 
the  effectivity  =  AN(fi)/\ s(fi)  —  sN(gJ)\  should  be  order  unity.  For  our 
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problem  it  is  simple  to  prove  that  r)N  {ff)  <  7 /c,  independent  of  fi  and  TV;  in 
practice,  effectivities  are  typically  less  than  10,  which  is  adequate  given  the 
rapid  convergence  of  reduced-basis  approximations. 

We  now  turn  to  the  computational  issues.  Prom  (2)  and  (7),  (12)  can  be 
re-written  as 

a(e(fj,),v)  = 

1  /  <5  N 

k(*>)  -  EE<j9(^uf 1 

Vv  e  Y. 

We  thus  see  from  simple  linear  superposition  that  e(/i)  can  be  expressed  as 

*00 = + ee^m^w)’ 

y^}  q=l  j=l 

where  zq  E  Y  satisfies  a(£o>v)  =  i(v),\fv  E  Y,  and  £?  E  Y,  j  =  1, . . . , TV, q  = 
1,...,Q,  satisfies  a(zq,v)  =  — v)> Vu  E  Y.  It  then  follows  that  we  can 
express  A N(fi)  of  (14)  as 


s+([i)  then  directly  follows  from  (13). 

The  off-line/on-line  decomposition  is  now  clear.  In  the  off-line  stage  we 
compute  zq  and  zq,j  =  1, . . . ,  TV,  q  =  1, . . . ,  Q,  and  then  the  inner  products 

c0)  A?,  and  Tqq,  defined  in  (16).  In  the  on-line  stage,  for  any  given  new  /x,  and 
given  sN(fj,)  and  uN(ff)  as  computed  in  the  on-line  stage  of  the  output  prediction 
process  (Section  2),  we  evaluate  AN(fj.)  as 


^  +  2EX>9M<MA*  + 

9=1  3= 1 

E  E  E  E^m^ ^)u?' (A0«£(M)r$ 

<7=1  q'  =  1  j=l  j'=l 
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and  then  evaluate  s+(fx)  =  sN(p)  +  A N({x).  The  incremental  cost  to  evaluate 
s+(/z)  for  any  given  new  \i  is  very  small:  0(N2Q2). 

4  Numerical  Algorithm 

In  the  simplest  case  we  take  our  field  and  output  approximations  to  be  u(jx)  = 
uN(fi)  and  s(fi)  =  sN(p),  respectively,  for  some  given  AT,  and  then  compute 
AN(p)  to  assess  the  error.  However,  we  can  improve  upon  this  recipe:  we  take 
u{fi)  =  uN(fj)  and  s(fx)  =  sN(fx),  where  uN(p)  and  sN (/x)  are  the  reduced-basis 
approximations  associated  with  a  subspace  of  WN ,  WN ,  in  which  we  select 
only  N  of  our  available  basis  functions.  In  practice,  we  include  in  WN  the  basis 
functions  corresponding  to  sample  points  pn  closest  to  the  new  fi  of  interest;  we 
continue  to  (say)  double  our  space  until  A N(fi)  <  e  (and  hence  \s(fi)  —  sN (fi)\  < 
e).  If  we  satisfy  our  criterion  for  N  <  N  the  adaptive  procedure  is  entirely 
contained  within  the  on-line  stage  of  the  procedure,  and  the  complexity  of  this 
stage  is  reduced  from  0(N2Q  +  N3  +  N2Q2)  to  0(N2Q  +  N3  +  N2Q2).  Note 
the  critical  role  that  our  error  bound  plays  in  effecting  this  economy. 

In  practice  —  to  ensure  that  the  are  actually  calculable  —  we 

replace  the  infinite-dimensional  space  Y  with  a  very  high-dimensional  “truth” 
space  Yt  (e.g.,  a  finite  element  space  associated  with  a  very  fine  triangulation). 
It  follows  that  we  obtain  bounds  not  for  s,  but  rather  for  st  =  £P(wr),  where 
ut  £  Yt  satisfies  a(uT,v;ix)  =  £(v),\/v  e  Yr-  The  essential  point  is  that  Yt 
may  be  chosen  very  conservatively  —  and  hence  the  difference  between  st  and 
s  rendered  arbitrarily  small  —  since  (i)  the  on-line  work  and  storage  are  in  fact 
independent  of  the  dimension  of  Yt,  Af ,  and  (ii)  the  off-line  work  will  remain 
modest  since  N  will  typically  be  quite  small. 


5  Results  and  Discussion 

We  first  demonstrate  the  accuracy  of  the  reduced-basis  output  prediction  and 
output  bounds  by  considering  the  case  Pe ff  =  5  in  which  L  =  2.5  and  t  =  0.25 
are  fixed;  the  remaining  parameters  fc1,  fc2,  A;3,  fc4,  Bi  vary  in  =  [0.1, 10]4  x 
[0.01, 1].  The  sample  points  for  SN  are  chosen  randomly  (uniformly)  over  Ves\ 
the  new  value  of  \i  to  which  we  apply  the  reduced-basis  approximation  is  k1  = 
0.5,  k2  =  1.0,  fc3  =  3.0,  A;4  =  9.0,  Bi  =  0.6  (similar  results  are  obtained  at  other 
points  in  Peff)-  We  present  in  Table  1  the  actual  error  | s(ji)  —  sN  (p)  |;  the 
estimated  error  A N(fi)  (our  strict  upper  bound  for  | s((jl)  -  sN (p,) |);  and  the 
effectivity  rjN(p)  (the  ratio  of  the  estimated  and  actual  errors).  We  observe  the 
high  accuracy  and  rapid  convergence  of  the  reduced-basis  prediction,  even  for 
this  relatively  high- dimensional  parameter  space;  and  the  very  good  accuracy 
(low  effectivity)  of  our  error  bound  A N(p)-  The  combination  of  high  accuracy 
and  certifiable  fidelity  permits  us  to  proceed  with  an  extremely  low  number  of 
modes. 
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N 

|s  —  | 

10 

4.68  x  10"3 

1.43  x  10-3 

3.06 

20 

4.70  x  10~4 

i.i3  x  nr3 

2.40 

30 

3.04  x  10"4 

1.04  x  10~3 

3.43 

40 

1.08  x  10“4 

4.61  x  10"4 

4.27 

50 

2.47  x  10~5 

6.89  x  10-5 

2.78 

Table  1 


As  regards  computational  cost,  in  the  limit  of  “infinitely  many”  evaluations, 
the  calculation  of  s(fj, )  to  within  0.1%  of  st  is  roughly  24  times  faster  than  di¬ 
rect  calculation  of  s t  =  £°(ut)\  here  u?  is  our  underlying  “truth”  finite  element 
approximation.  The  breakeven  point  at  which  the  reduced-basis  approximation 
first  becomes  less  expensive  than  direct  evaluation  of  St  is  roughly  250  evalua¬ 
tions.  These  are  fair  comparisons:  our  “truth”  approximation  here  is  not  overly 
fine,  and  our  solution  strategy  for  ut  €  Yt  (an  ILU-preconditioned  conjugate- 
gradient  procedure)  is  quite  efficient.  The  reduced-basis  approach  is  much  faster 
simply  because  the  dimension  of  WN ,  A",  is  much  smaller  than  the  dimension 
of  Yt  ,  Af  (which  more  than  compensates  for  the  loss  of  sparsity  in  A) .  For  more 
difficult  problems  that  require  larger  A/",  or  that  are  not  as  amenable  to  fast 
solution  methods  on  Yt,  the  relative  efficiency  of  the  reduced-basis  approach  is 
even  more  dramatic. 

The  obvious  advantage  of  the  reduced-basis  approach  within  the  design,  op¬ 
timization,  and  control  environment  is  the  very  rapid  response.  However,  the 
“blackbox”  nature  of  the  on-line  component  of  the  procedure  has  other  advan¬ 
tages.  In  particular,  the  on-line  code  is  simple,  non-proprietary,  and  completely 
decoupled  from  the  (often  complicated)  off-line  “truth”  code.  This  is  particu¬ 
larly  important  in  multidisciplinary  design  optimization,  in  which  various  mod¬ 
els  and  approximations  must  be  integrated. 

We  close  this  section  with  a  more  applied  example.  We  now  fix  all  parameters 
except  L  and  t,  so  that  Pe$  =  2;  (L,£)  vary  in  Deff  =  [2.0, 3.0]  x  [0.1, 0.5].  We 
choose  for  our  two  outputs  the  volume  of  the  fin,  V,  and  the  root  average 
temperature,  s.  As  our  “design  exercise”  we  now  construct  the  achievable  set 
—  all  those  (V,s)  pairs  associated  with  some  (L,t)  in  the  result,  based 
on  many  evaluations  of  (V,s+)  for  different  values  of  (L,t)  e  £>eff>  is  shown  in 
Figure  2.  We  present  the  results  in  terms  of  rather  than  sN  to  ensure  that 
the  actual  temperature  s t  will  always  be  lower  than  our  predictions  (that  is, 
conservative);  and  we  choose  N  such  that  is  always  within  0.1%  of  st  to 
ensure  that  the  design  process  is  not  misled  by  inaccurate  predictions.  Given 
the  obvious  preferences  of  lower  volume  and  lower  temperature,  the  designer 
will  be  most  interested  in  the  lower  left  boundary  of  the  achievable  set  —  the 
Pareto  efficient  frontier;  although  this  boundary  can  of  course  be  found  without 
constructing  the  entire  achievable  set,  many  evaluations  of  the  outputs  will  still 
be  required. 
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Figure  2 


6  Generalizations  and  Issues 

Many  of  the  assumptions  that  we  have  introduced  are  assumptions  of  conve¬ 
nience  and  exposition,  not  necessity.  First,  the  output  functional  £°  need  not 
be  same  as  the  inhomogeneity  l\  with  the  introduction  of  an  adjoint  (or  dual) 
problem  [2],  our  results  above  extend  to  the  more  general  case.  Second,  the  func¬ 
tion  g(ji)  need  not  be  known  a  priori:  g(p)  is  related  to  an  eigenvalue  problem 
which  can  itself  be  readily  approximated  by  a  reduced-basis  space  constructed 
as  the  span  of  appropriate  eigenfunctions  (in  theory  we  can  now  only  prove 
asymptotic  bounding  properties  as  iV  — >  oo,  however  in  practice  the  reduced- 
basis  eigenvalue  approximation  converges  very  rapidly,  and  there  is  thus  little 
loss  of  certainty).  Third,  these  same  notions  extend,  with  some  modification,  to 
noncoercive  problems,  where  g(y)  is  now  in  fact  the  inf-sup  stability  parameter 
[3,  4].  Finally,  nonsymmetric  operators  are  readily  treated,  as  are  certain  classes 
of  nonlinearity  in  the  state  variables  (e.g.,  eigenvalue  problems  [1]). 

Perhaps  the  most  limiting  assumption  is  (2),  affine  dependence  on  the  pa¬ 
rameter  functions.  In  some  cases  (2)  may  indeed  apply,  but  Q  may  be  rather 
large.  In  such  cases  we  can  reduce  the  complexity  and  storage  of  the  off-line 
and  on-line  stages  from  0(Q 2)  to  0(Q)  by  introducing  a  reduced-basis  approx¬ 
imation  of  the  error  equation  (12)  for  a  suitably  chosen  “staggered”  sample  set 
S^r  and  associated  reduced-basis  space  constructed  as  the  span  of  appropriate 
error  functions.  These  ideas  also  extend  to  the  case  in  which  the  parameter  de¬ 
pendence  can  not  be  expressed  (or  accurately  approximated)  as  in  (2);  however 
we  now  need  to  at  least  partially  abandon  the  blackbox  nature  of  the  on-line 
stage  of  computation,  allowing  evaluation  (though  not  inversion)  of  the  truth- 
approximation  operator,  as  well  as  storage  of  some  reduced-basis  vectors  of  size 
A f.  These  methods  are  currently  under  development. 
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